Photography system to organize digital photographs and information regarding the subjects therein

ABSTRACT

A photographic processing system in which subject and other data is stored and such data is automatically linked to photographs taken using either a film or digital camera.

CROSS-REFERENCED TO RELATED APPLICATIONS

This application is a continuation of U.S. Ser. No. 13/789,140, filed onMar. 7, 2013, which is a continuation of U.S. Pat. No. 8,427,543, filedon Feb. 2, 2012, issued on Apr. 23, 2013, entitled PHOTOGRAPHY SYSTEM TOORGANIZE DIGITAL PHOTOGRAPHS AND INFORMATION REGARDING THE SUBJECTSTHEREIN, which is a continuation of U.S. Pat. No. 8,130,276, filed onSep. 22, 2008, issued on Mar. 6, 2012, entitled PHOTOGRAPHY SYSTEM TOORGANIZE DIGITAL PHOTOGRAPHS AND INFORMATION REGARDING THE SUBJECTSTHEREIN, which is a continuation of U.S. Pat. No. 7,446,800, filed onOct. 8, 2002, issued on Nov. 4, 2008, entitled METHODS FOR LINKINGPHOTOGRAPHS TO DATA RELATED TO THE SUBJECTS OF THE PHOTOGRAPHS, thedisclosures of which are hereby incorporated by reference in theirentireties. To the extent appropriate, a claim of priority is made toeach of the above disclosed applications.

BACKGROUND OF THE INVENTION

I. Field of the Invention

The present invention relates to a system for creating, editing,processing and printing photographs. More specifically, the presentinvention relates to equipment which allows a photographer to takepictures of a large number of subjects, link the pictures to data usedin processing the pictures, edit the pictures and processing data,deliver the pictures and data to a lab which processes the photographsin a manner consistent with the data.

The system of the present invention is ideally suited for use bycommercial photography businesses. The system of the present inventionenables such businesses to efficiently photograph large numbers ofsubjects and process the photographs to provide quality prints of adesired size, composition and number to a customer.

II. Discussion of the Prior Art

The advent of modern automated processing systems for commercialphotographers occurred in 1981. In that year, Talmadge Hopson completedhis invention of a camera system that allowed a photographer to marryphotographs to data related to the photographs. That camera system isdescribed in U.S. Pat. No. 4,422,745 granted Dec. 27, 1983. That camerasystem, referred to in the trade as the Micro Z, has been used byLifetouch National School Studios to efficiently produce and processschool photographs since that time.

A significant advance in the art provided by the Micro Z was the abilityto print a bar code on film adjacent to a photograph. This is shown inFIG. 13 of the Hopson patent. Data is supplied to the camera eitherusing a data card reader which reads customer order cards or a 16-keydata entry keyboard shown in FIG. 1. The camera writes the data in barcode format on the film adjacent the photograph as the film advances.The data in the bar code can include information such as an operator(photographer) I.D., a class code signifying the classroom of studentsthe subject is associated with, the date the picture was taken, the rolland frame number of the film, and a package print selection which isused to tell the processing lab the size and number of prints to becreated. The camera's controller is designed so that pictures cannot betaken unless all of the required data has been entered. This ensuresthat the processing plant will have this data for processing purposes.The Micro Z has been successfully used by Lifetouch National SchoolStudios for 20 years to efficiently produce school photographs.

One disadvantage of recording data on film is that the data cannot becorrected even if it contains errors. The film serves as a “one-timeprogrammable” memory. Another disadvantage is that since the data iswritten to the film as the film is advanced, the data must be enteredinto the camera before the film is advanced. Still other disadvantagesexist, because the shutter is locked closed until the data is entered toensure the data is properly matched to the photograph. Photographerssimply cannot take a new picture until the data for the new picture isentered. Particularly when photographing young children, whose moods andexpressions change rapidly, there is a real need to be able to takepictures first and enter data later.

The Micro Z camera disclosed in the Hopson patent was developed in anera when microprocessor technology was in its infancy and memory wasvery costly. With improved technology in these two areas, film camerascan be improved to overcome many of the disadvantages discussed aboveand to expand the amount of data available for use in processing thefilm. With the advent of high quality digital cameras, even furtheradvantages are available.

SUMMARY OF THE INVENTION

The present invention represents a significant improvement to the Hopsonpatent that can be implemented using either a film camera or a digitalcamera. The system of the present invention allows vast amounts of dataand large numbers of photographs to be linked together and used toefficiently fill customer orders for photograph prints.

With either a film camera or a digital camera implementation of theinvention, a link must be created between each photograph taken and thedata relevant to that photograph. Once this link is created, a varietyof data can be associated with the photograph. This includes subjectspecific information such as the names, addresses, phone numbers,school, grades and student identification numbers of those pictured.This also includes frame specific information such as a frame number andprinting instructions for the lab related to the specific picture.

The data can also include order information indicating what productshave been ordered by a customer and what frames should be used to fillthe order. Where the picture includes a group of subjects, the data canalso include information related to the group such as the name of thegroup shown, the name of the group's coach or advisor, and the names ofthe group members. Other data can also be included to give thephotographer additional artistic control. This data can be used toinstruct the lab to crop the photograph, to substitute a background, toadd vignettes, to soften the focus or the like. The above discussionrepresents only some of the data that can be linked to the photograph toensure proper and efficient processing of customer orders.

Other advantages arise from the use of the present invention as opposedto the system disclosed in Hopson. First, nearly all of the data can becreated, saved or edited at any time. When Micro Z cameras are used,this must all occur before the data is printed to the film. Second, thepresent invention, when implemented using digital photography, allowsthe pictures to be immediately displayed so that the customer can havethe benefit of viewing the frame in advance of making a purchasingdecision. Additional pictures can be taken if none are deemed acceptableto the customer. All of this can be done without the inefficienciesassociated with printing proofs and shipping them between the lab, thephotographer and the customer. Third, with the present invention, thephotographer can exercise real creative control by adjusting thecomposition of the photo using a variety of software features or throughdirections given to the lab via the data associated with the photograph.

These and other benefits will be more readily understood by reading thedetailed description of the invention set forth below in view of thedrawings provided herewith.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a preferred embodiment of the presentinvention.

FIG. 2 is a block diagram of a camera and protective case.

FIG. 3 is a block diagram of a computer that can be coupled to thecamera of FIG. 2 to make the camera a network camera capable of usewhile practicing the present invention.

FIG. 4 is a block diagram of a computer that can be coupled to thecamera of FIG. 2 to make the camera either a network or stand-alonecamera capable of use while practicing the present invention.

FIG. 5 is a block diagram showing how the computers of FIGS. 3 and 4 canbe used in a networked environment to practice the present invention.

FIG. 6 is a diagram showing the manner in which data and photographicframes are collected and linked in a database.

FIG. 7 is a block diagram of a data structure that can be used when arelational database is employed to practice the present invention.

FIG. 8 is a sample data card that can be used in conjunction with thepresent invention.

FIG. 9 is a flow chart showing one mode in which the combination cameraand computer of FIGS. 3 and 4 can be used.

FIG. 10 is a flow chart showing a second mode of operation of saidcombination camera and computers.

FIG. 11 is a flow chart showing a third mode of operation.

FIG. 12 is a flow chart showing a fourth mode of operation.

FIG. 13 is a flow chart showing a fifth mode of operation.

FIG. 14 is a flow chart showing a sixth mode of operation; and

FIG. 15 is a flow chart showing a seventh mode of operation.

FIG. 16 is a diagram showing how an image/data link is created.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

As shown in FIG. 1, the system of the present invention includes acamera 1 and a computer 2 or 2′. The computer 2 can be self-containedwithin the housing of the camera 1. Alternatively, the camera 1 can becoupled to the computer using a RS232, USB, fire wire or any other datacommunications connection 3. Ideally, the camera is encapsulated in aprotective case 11. Coupled to the computer 2 are a keyboard 4, ahand-held controller 80 and a card reader 5 for entering data, and adisplay 6 and printer 7 for viewing data. The printer 7 can also be usedfor on-site production of photographic prints. There must also be somemechanism for delivering data to a server 8 located, for example, in theprocessing lab. This can be done in any of a variety of ways. Thecomputer 2 can connect to the server 8 in a wired or wireless fashiondirectly or over the Internet. Alternatively, the data can be deliveredto the lab on a disk, tape or any other transportable media.

The principal function of the camera 1 is to capture images. The camera1 can either be a film camera or a digital camera. When a film camera isused, the images are captured on a frame of film. When a digital camerais used, digital representations of the photographic images are capturedin a digital frame file in the memory of the digital camera. A separatedigital representation is captured each time a shutter actuator isactuated. Unless otherwise indicated, the term “frame” is used herein toindicate either a frame of film or a digital representation of an imagewhich could be a file or any other block or collection of datacontaining a digital representation of the image. The term “shutteractuator” relates to any type of mechanism which triggers the capture ofan image. This term is not limited to conventional shutters used on filmcameras.

The computer 2 of the present invention serves a variety of functions.As will be discussed in further detail below, the computer 2 controlsvarious operations of the camera 1. The computer is also used to collectand process data. Data is collected by the computer 2 in any number ofways. The keyboard 4 and card reader 5 can be sources of data. A dataconnection 9 with the server 8 can provide a source of data. Data canalso be supplied to the computer on physical media in addition to cardsread by the card reader 5 such as disks or tapes if the computer 2 isequipped with a suitable disk or tape drive. The camera 1 also suppliesdata to the computer 2. The data received from all of these sources isused to manage photographic processing. Data and digital photographs canalso be viewed or printed using the display 6 and printer 7,respectively. A key feature of the present invention is the linking ofdata to the frames containing photographs. This feature is discussed ingreater detail below.

FIGS. 2-5 are provided to show how an off-the-shelf digital camera 1,such as a Nikon Model DIX, can be combined with other equipment toachieve the benefits of the present invention. In the embodiment shownin these figures, the camera 1 is the fundamental image capturecomponent in the system. The camera 1 is preferably physicallyencapsulated in a protective case 11 for three important reasons. First,off-the-shelf cameras are not as robust as is typically required forcommercial use taking into account the large number of pictures taken ina commercial application. Second, the protective case 11 is designed sothat a single connector 12 is used to connect the camera 1 to thecomputer 2, thus eliminating the need for multiple camera connections,each of which can be somewhat fragile. When the protective case 11 isprovided, the various electrical inputs and outputs of the camera 1 areall wired to the single, field reliable connector 12 on the protectivecase 11. Third, because the camera will be controlled by the system'scomputer 2 rather than the buttons and knobs on the camera 1, theprotective case 11 precludes access to certain buttons and knobs on thecamera 1. For example, the case 11 can be designed so the photographerhas access to the shutter button, but not to other controls on thecamera 1 itself so that shutter speed, aperture, film speed or the likeare all controlled by the system's computer 2. Also, additional switchesand ports can be incorporated into the protective case 11. For example,a switch can be provided to indicate to the computer 2 whether housingis in the portrait or landscape (vertical or horizontal) position sothis data can be automatically captured and recorded in a database.Also, such ports can be used to connect the separate hand-held computercontroller 80, a separate video camera 82, or any number of otherdevices. (See FIG. 1).

FIGS. 3 and 4 show two different embodiments of the computer 2, one inwhich the camera 1 must be used as part of a network and another inwhich the camera 1 can either be networked or used on a stand-alonebasis. The computer shown in FIG. 3 is intended to be networked. Thecomputer comprises a capture processor 14, which is an embeddedmicroprocessor-based computer packaged in a small form. The embeddedcapture processor 14 could, for example, be a Pentium processor packagemanufactured by Intel Corporation that uses an embedded MicrosoftWindows operating system such as Embedded XP. Other software run by theprocessor 14 includes an interface to the camera 1; a user interface fordata input, viewing, editing and the like; basic image processing tomeet color balance, size and sharpness requirements of the commercialenterprise; and image transfer software for transferring images from thecamera 1 to the computer 2 and from the computer 2 to other devices on anetwork.

The computer 2 shown in FIG. 3 must also be equipped with certain portsfor coupling additional hardware to the computer 2. As shown, theseports include an input device port 16 to which a mouse and keyboard canbe attached. A VGA/LCD display port 17 to which a suitable display canbe attached, a serial port 18 to which the bar code reader can beattached, a sync out port 19 for radio slave operation, an interface 20(such as a fire wire port) to which the camera 1 is attached, a networkinterface card 21 such as a 10/100 BaseT NIC for attaching the computer2 to a network, a wireless network interface card 22 for making awireless connection between the computer 2 and a network, and a jack 23for controlling the actuation of lighting during photography. Thecomputer 2 can also be equipped with additional serial ports, parallelports, USB ports, fire wire ports, and power jacks so that additionalequipment can be coupled to the computer 2.

The computer 2 shown in FIG. 3 is not intended to be used on astand-alone basis so it is not equipped with either a hard drive orother disk drive for recording data or images. All data and images areintended to be stored on a server on the network to which the computer 2is attached.

FIG. 4 shows an alternative embodiment of the computer which, whenimplemented, allows the camera to be used either on a networked orstand-alone basis. This version is ideally suited for situations where anetwork connection to the lab is not available at the site where thephotographs are being taken. The computer 2′ shown in FIG. 4 is verymuch like the computer 2 described above with reference to FIG. 3. Thereare two differences, however, First, the computer 2′ shown in FIG. 4includes a hard disk 24 and either a CD-R writer 25 or a DVD writer. Thehard disk 24 is used to store the data of a database as well as imagestaken by the camera 1. The CD-R writer 25 or DVD writer can be used tostore data and/or images on either CD-Rom or DVD media for transfer tothe lab. Alternatively, the system can later be moved to a locationwhere a network connection is available and either the 10/100 BaseT orwireless network cards 21 and 22 can be used to transfer data and imagesto the lab.

The computer 2′ of FIG. 4 must also be equipped with certain additionalsoftware to function as a stand-alone system. This includes CD-Romwriting software and can also include proof printing software when thereis a desire to produce on-site proofs of the pictures taken and a proofprinter 7 (See. FIG. 1) is provided.

FIG. 5 is provided to show how either the computer 2 shown in FIG. 3 orthe computer 2′ shown in FIG. 4 can be used to connect cameras to anetwork to create a multiple camera capture system. In addition to apair of cameras 1 and 1′ which are respectively coupled to computers 2and 2′, FIG. 5 shows a server 8. The server 8 is essentially a fileserver with a large, hard disk. The file server stores image files anddatabase data on the hard disk. Essentially any high performance fileserver running under a suitable operating system can be used.Preferably, the file server 8 will be equipped with a CD-R or DVDread/write drive 32 and multiple 10/100 BaseT and wireless networkconnections 34 and 35. Alternatively, a router or switch could be usedto control traffic between the server 8 and computers 2 and 2′ and otherdevices in the network. Either the drive 32 or network connections 34 or35 can be used to transfer data and images between the computers 2 and2′ and the server 8. An uninterruptible power supply (not shown),printer ports 36 and fire wire ports 38 are also preferably provided. Afire wire port could, for example, be used to connect a camera 1directly to the server 8.

In addition to the operating system, the server 8 should be equippedwith other software. Such software includes image handling software,image processing software, database management software, proofingsoftware, CD-R and DVD writing software, and the like. Such software isvery much dictated by the functions to be performed.

The functions performed by the server 8 include saving data and images,processing of the images, processing of data, image storage, orderprocessing, sales tracking, and controlling the printing of orders viaprinters attached to the printer ports.

To store data on the server 8 in a useful format, a database must becreated. As used herein, “database” means any collection of data orinformation. Various types of databases can be used including ahierarchical database, a network database, or a relational database. Thedatabase can be present on the computer 2′, on server 8 if aclient/server model is used, or both. Ideally, much of the data willalready be stored in the database before the photographic sessionbegins. Of course, data can and usually will be added to the databaseeither during or after the photographic session.

To fully appreciate the advantages of the present invention, one needsto understand the different kinds of data that can be stored in thisdatabase and linked to each photograph frame. As shown in FIG. 6, thisdata generally falls into six groups—subject data 40, frame data 41,composition data 42, group data 43, order data 44, and link data 45. Theframes 46 can also be considered data.

Subject data 40 is any data specifically related to the subjectphotographed. Such data can include the name of the subject, the addressof the subject, the telephone number of the subject, the home address ofthe subject, the e-mail address of the subject, the school the subjectattends, the class the subject is in, or any other data used to identifya subject such as a student identification number, driver's licensenumber or social security number. The subject data will also include anidentification code unique to the particular subject.

Frame data 41 can be defined as any data specifically related to a frameof film or a frame file in which the image is stored. This data caninclude a frame number assigned by the camera, an indication of whetherthe picture was taken in a portrait or landscape fashion, or data to beused by the lab for post-processing of the photographs.

A subset of frame data 41 is composition data 42. Composition data isused by the photographer to give instructions to the lab forpost-processing of the photograph. Specifically, the photographer cansupply data indicating how the picture should be corrected to addressflows before printing. The photographer can instruct the lab to crop orzoom the image to correct positioning errors. The photographer caninstruct the lab to perform exposure correction or color correctionalgorithms. The photographer can instruct the lab to substitute a newbackground, add vinettes, or apply a “soft focus” look. The photographercan also instruct the lab to otherwise touch up the photograph to maskskin blemishes. Composition data can also include data collected andstored in a manner with EXIF specifications. EXIF specifications relateto attaching metadata to digital pictures. Such data typically relatesto forms and exposure settings used to take the picture. It does notinclude subject data.

Group data 43 needs to be associated with the photograph whenever thephotograph is of a group of subjects. Any data specifically related to agroup is group data. Group data can include the name of the group, thenames of the members of the group, the names of the group's leaders, theorganization or institution the group is affiliated with, or the like.

Still another kind of data used by the system is order data 44. Thisdata is used by the lab to determine what products to create and whatframe or frames to use in the creation of a product. Recently, variousstandards have emerged to permit printers to directly produce copiesfrom the storage devices of digital cameras. Under these standards, somedata is associated with the picture. Such data falls within the term“order data” as that term is used herein. Of course, storing such datain a manner consistent with such specification is fully consistent withthe application of the present invention.

From the foregoing, those skilled in the art should recognize thatvarious types of data can advantageously be collected for use in thelab. Those skilled in the art should also recognize that this data mustbe matched to the correct photographs. A mismatch of data will bringautomated processing to a halt. Thus, the system of the presentinvention also creates and utilizes link data 45. In the most basic ofsituations, the database will include the name of the subject and anidentification code unique to the subject. The unique identificationcode is entered into the camera system. When the photograph is taken,not only is the image created, but also the unique identification codeis linked to the photograph. In the present invention, this is doneautomatically by creating link data which associates the frame (whichcan either be a frame of a roll of film or a set of data in which adigital representation of the image is stored) with the uniqueidentification code of the subject. Digital images (i.e. frames) can bestored in individual image files or collectively in a database file.Link data includes any data used to link frames, frame data, subjectdata, group data, composition data or order data. Preferably, the linkdata is stored in the computer. The link data could also be stored inthe camera (or on film) as part of the frame. The link data could bestored in both of these places or even other places as well.

It must also be recognized that data collecting and data linking ormatching must be done in a fashion that does not interfere with theefficient taking of high quality pictures. Different techniques shouldbe used to collect and match the data to ensure high quality photographyin different situations.

As indicated above, various types of databases can be employed. FIG. 7shows how the data might be organized in a relational database. As shownin FIG. 7, the database comprises nine tables. These include subjecttable 50, school table 52, group table 54, status table 56, frame table58, composition table 60, order table 62, package table 64 and optiontable 66.

Subject table 50 is the table which all the data related to anindividual subject is stored. The subject ID stored in this table isused to link the data in the table to the group table 54, the frametable 58, the order table 62, and vice versa. The data in the subjecttable 50 is also relationally linked to the school data table 52 throughthe school ID data field. Similarly, the subject table 50 is linked todata in the status table 56 through the status ID field.

A separate status ID is assigned for students, principals, teachers,teacher's aids, staff, coaches, etc. The drop-down menu allows the userto select the correct status for the subject from the available optionslisted in the status table 56.

School data, of course, falls within the realm of subject data. However,by placing school data in a separate table 52 and linking this data tothe subject data in the subject table 50 using the school ID field, allof the data in the school table 52 does not need to be re-entered andstored separately for each subject. This structure not only saves time,but also storage space. School data helps identify the school, variouspersonnel and also rules the school may have for yearbook pictures. Ifthe school desires a consistent background or that all yearbook picturesshow the student in uniform, this information can be stored in theschool table 52.

Schools are divided into many different groupings. The group table 54,which is linked to the school table 52 using the school ID field, allowsinformation related to such groups to be stored in the database.Teaching staffs, for example, are often divided into departments.Information related to staff comprising the math department, thelanguage arts department, the social studies department, the sciencedepartment, or any other staff group can be stored in the group table54. Likewise, students are often divided (or divide themselves) intogroups such as classes, teams, clubs or the like. Again, informationrelated to such groups can be stored in the group table 54. Informationthat can be stored by a group in the group table 54 includes a uniquegroup ID for each group and the school ID for the group so the groupinformation can be linked to the correct school and the data for thatschool stored in the school table 52. Most importantly, the group table54 includes group name, the subject ID of each group member and thesubject ID of each group leader. The subject ID is used to link the datain the group table 54 to the data in the subject table 50 for eachmember of the group.

The collection of all of this data would be of little use if it were notcapable of being linked to the frames which store the pictures taken.The frame table 58 includes a unique frame ID for each picture taken.When a digital camera is used, the frame ID will typically identify thelocation and name of the frame file. When a film camera is used, theframe ID identifies the roll of film and frame number on which thephotograph is stored. When the picture saved in a frame is of a singlesubject, the frame table 58 includes the subject ID of the subject. Thispermits the frame to be linked to all of the data in the subject table50. When the picture saved in a frame is of a group, the frame table 58includes the group ID of the group so that the frame is linked to allthe data in the group table. Other information such as the date thepicture was taken can be stored in the frame table 58 as well. Editinginstructions for the processing lab can be stored in table 58, but foradded flexibility such data can be stored in a separate compositiontable 60 which is linked to the frame table 58 by the frame ID.

From a commercial standpoint, none of this would be particularly usefulwere it not for the ability of the system to assist in automaticprocessing of orders. Most information related to an order is stored inthe order table 62. Orders are placed by subjects. Thus, order table 62is linked to the subject table 50 using the subject ID. Orders are alsotypically frame specific. Thus, each order is linked to a frame usingthe frame ID. To assist in processing, various standard packages havebeen developed. Each package is assigned a separate letter. The packageletter and the specification for each of the standard packages arestored in table 64. Likewise, several options are available for eachpackage. A unique option number is assigned to each option. The optionnumber and the specification for each option is stored in option table66. The customer can select from these packages and options. Theappropriate package letter and option number is stored in table 62.Again, tables 64 and 66 can be used to create drop-down menus for use infilling out customer order information.

There may also be times when a customer desires something different thanwhat is offered in the standard packages and options. The quantity andsize of prints for a special order can be reflected in order table 62.Information related to the price charged and whether payment has beenreceived can also be stored in order table 62. Information related todate an order was placed, processed and shipped can also be included inorder table 62.

Those familiar with relational database design will be able to design auser interface that permits one to use the database to quickly andefficiently enter, display, edit, or print data. This interface can bedesigned, for example, so that scanning of a card in the card reader 5will cause the system to call up and display a particular set of subjectdata. The interface should also be designed to include logical dataentry screens to enable efficient data entry using the keyboard, a mouseor other data entry tools. This is particularly important when enteringorder information. Finally, when photographs are stored in a digitalframe, the interface should be designed so that the photographs of asubject or group can easily be recalled and displayed either by enteringthe appropriate subject ID or group ID.

So that data collection only minimally interferes with the actual takingof photographs, in most cases all of the data stored in the frame tableis generated automatically. When a picture of an individual subject isto be taken, a card such as the one shown in FIG. 8 containing thesubject ID is inserted into the card reader. The system displays thesubject information for the subject and perhaps also displays a picturepreviously taken of the subject so the photograph can verify that thecorrect subject ID is being used. The photographer then takes thepicture and the system generates the frame ID, associates it with thesubject ID in the frame table 58, determines whether the camera was inthe landscape or portrait mode, and stores all of this data as well asthe data in the frame table 58.

The system works in a similar fashion when a picture of a group istaken. If group information for the group already exists in thedatabase, the photographer merely enters the group ID and verifies thatthe correct group ID is entered using information automaticallydisplayed by the system. If the information is for the correct group,the photographer takes the picture. The system then automatically addsthe frame ID for the picture, the group ID for the group shown in thepicture, the orientation of the camera when it took the picture and thedate the picture was taken to frame table 58.

If the group to be taken is a new group to which no group ID waspreviously assigned, the system not only creates information for theframe table 58, but also for the group table 54. The photographer entersa command requesting the system to create a new group and then insertsthe cards for each member of the group into the card reader to identifythe members of the group. The subject ID for each member is stored inthe group table. The algorithms used allow the system, based upon acomparison of the status ID of each subject, to automatically determinewho the group leaders (i.e., teachers, coaches, or the like) are. This,of course, can be edited later if there are processing errors.Information on any subject not in possession of a card like the oneshown in FIG. 8 can be added to the group table 54 and subject table 50using the keyboard at any time. Once all the members of the group havebeen identified, the photographer takes the picture. The system assignsand stores the frame ID for the picture in the frame table 58 along withthe group ID, the orientation and date information.

Ideally, before a photographic session begins, most if not all of thedata in the subject, school, group, status, package and option tableswill already be in the database. Information in the frame table isautomatically generated as photographs are taken. Data in the order andcomposition tables can be added during the session or later. Data in anyof the tables can be edited at any time.

While FIG. 7 shows a relational database structure, other databasestructures can be used. The use of a relational database offers theadvantage of avoiding the need to store significant amounts of redundantdata. Also, the database structure shown in FIG. 7 is intended to beexemplary rather than limiting. The organization of data, tables,relationships and the like can be modified. Also, additional data can beadded to what is shown or some of the data that is shown eliminatedwithout deviating from the invention.

From the foregoing, certain advantages to the arrangement shown in FIG.5 should be apparent. The structure shown in FIG. 5 suggests that thedatabase can reside either on the computer 2′ or a server 8. Theadvantage of having the database reside in the computer 2′ is that nohigh speed data connection must exist between the camera system and thelab. However, where such connections are available (and they are nowavailable in many if not most schools), there are benefits of having thedatabase and frames stored on a central server 8 such that the camerasystem operates as a client in a client/server network. In thisenvironment, multiple camera systems can share data and frames. Multiplephotographers can all work effectively at a single school site either atthe same time or at different times and not have to worry aboutsynchronizing data because this would be done automatically on theserver 8.

The client/server model also offers advantages of a commercialenterprise maintains a number of different locations where studioportraits can be taken and prints of the photographs purchased. Thecustomer need not return to the same store where the photographs aretaken to order prints because all stores would have access to thedatabase and frames. The customer could even choose to order prints ofphotographs taken at different locations.

When a client/server model is used, a store or even a portable studiocan be set up with multiple stations, some used to take pictures, othersused to enter or edit data, and still others used to take orders. Thiscan greatly increase the efficiency of personnel and enhance theexperience for customers.

Still another advantage of a client/server model is that the customer,by using the subject ID and password stored in the subject table, canview digital frames and place orders from any computer having access tothe Internet. The system can be set up to be user friendly and to ensureproper security such that access is limited to frames containingpictures of the subject to a group to which the subject belongs. Thesystem could also be used to allow a customer have the lab process andprint pictures taken by the customer using a digital camera. Thecustomer would simply need to attach the picture files from his or herdigital camera to a message containing the subject ID and send thismessage to the lab. The system automatically generates a frame ID foreach such picture and automatically stores the frame ID, subject ID anddate in the frame table 52. Order information also received over theInternet is automatically stored in table 62. Orders, when complete, areshipped to the address for the subject stored in the subject table 50,the accuracy of which can be verified by the customer. Paymentinformation can also be stored in the order table 62.

As mentioned above, FIG. 8 shows a card 100 that can be printed from thedatabase using the printer 7 shown in FIG. 1. The card 100 shouldideally include the first name 101 and last name 102 of a subject to beprinted. The card also can include other identification information suchas the subject's grade 103 and the number 104 of the student's teacher.The card also includes a unique identification number 105 for thestudent represented not only alphanumerically, but also in a machinereadable format such as bar code 106. Other machine readable formats canbe used without deviating from the invention. Separate cards 100 can beprinted and distributed to each student in the class.

The cards 100 are not only used to reflect information already in thedatabase, but can also be used to supply other information which can beadded to the database such as the student's homeroom number, the classperiod the student has the teacher, the student's student identificationnumber, the student's locker number, the student's date of birth, thestudent's bus number, etc. The card 100 can also be used to identify theproducts (packages) the subject wishes to purchase. In the exampleshown, the customer can use the card 100 to select between any of tendifferent packages each having five different options. The additionaldata conveyed on these cards can be entered into the database at a pointin time.

The cards 100 are not only used to verify data in the database and enternew data, but are also used in matching data in the database tophotographs that are taken. As mentioned above, the card 100 can beinserted into the card reader 5 before the subject is photographed. Thecard reader 5 reads the machine readable code 106 to quickly tell thesystem the identity of the subject being photographed. This is far moreefficient than using the keyboard 4 which can also be used to supplycorrect identification information for the subject to be photographedand is highly advantageous when taking numerous photographs of differentsubjects or when taking a photograph of a large number of subjects. Withthe subject or subjects of a photograph properly identified using theunique identification number for the subject embedded in the bar code106, the system can quickly and effectively link a frame to the subjector subjects shown in the image captured in the frame.

As suggested above, the system of the present invention offers twodistinct advantages over that discussed in the Hopson patent. First, thedata can be edited any time. Second, the data can be supplemented at anytime. These two advantages arise from the fact that the bulk of the datain the database is stored on a media that permits editing rather than onfilm.

The ability to edit data makes it, for the first time, practical to usethe modes of operation shown in FIGS. 9-12, 14 and 15. When one isunable to edit the data, steps must be taken to force the entry of dataprior to the time each photograph is taken as suggested in FIG. 13. Theability to edit the data allows one to correct errors and even re-linkthe frames.

The ability to add data after the photography session is complete isalso highly beneficial. For example, if the cards of the type shown inFIG. 8 are used, a photographer need not key in new data written on thecard before the picture is taken. Instead, the photographer can use thecards to associate the subject with the frame as discussed above. Later,after the photo session is complete, the photographer can again insertinto the card reader 5 any cards 100 to which information has been addedto call up the data for the particular subject. The new or editedinformation on the card can then be entered by the photographer usingthe keyboard 4 to modify the data in the database for the particularsubject. For example, the photographer can use this method to indicatethe package ordered by the subject and whether payment has been receivedfor the package.

Even greater advantages can be derived from the invention when theimages are stored digitally. Frames can be printed or displayed. Thephotographers can edit the frames themselves to improve the quality ofthe image. Alternatively, the photographer can provide editinginstructions to the lab in the form of composition data. Such editingcan include substituting backgrounds, softening the focus, addingvignettes, cropping the image, zooming in or zooming out, or the like.

When digital photography is used, the photographer can also display orprint the images so that the customer can choose between several images,rank the images, decide which of several images to use in a yearbook, orcreate a unique package from the images to be purchased by the customer.The database can be supplemented to include such order information andthe lab can then use this order information for processing.

As indicated above, the database can be stored on a server 8 in aprocessing lab to create a client/server relationship between the laband the computers 2 or 2′. When this arrangement is used, the system haseven greater flexibility. Photographs of the same subject can be takenat different times, at different sites and by different photographers.Since the frames for these photographs are all linked together using thesubject's unique identification code, all of the frames for the subjectcan be downloaded to a particular computers 2 or 2′ and displayed forranking, selection and ordering. Also, if the subject's uniqueidentification code, data and frames are maintained over a period ofyears, new products containing photographs taken over time can quicklyand easily be created using the various image files and the database.For example, a customer could order a collage of the annual schoolpictures taken of their child from kindergarten through the senior yearof high school. Thus, many other specialty products become available forthe first time because of the robust nature of the data system of thepresent invention.

Given the robust nature of the present invention, various prints can beeasily and efficiently created using the frames and associated subjectdata. The system of the present invention allows random pictures to becombined into groups through the use of the subject data. For example,school pictures of students can be organized in an infinite number ofgroupings. They can be arranged alphabetically. They can be grouped byclass assignment. They can be grouped by bus assignment. They can begrouped by locker assignment. They can be grouped based upon honorsearned (honor roll, National Honor Society, team captains, classofficers, all-conference, etc.). Once grouped, the system can createattractive prints of the grouping which can be used in any number ofways.

Prints created using a printer attached to the system are just one typeof output the system is capable of generating. Individual pictures,group pictures or groups of pictures can be output to one or moredisplays. Such items can also be output to and recorded electronicallyon a CD-Rom or any other type of storage media. Other such storagedevices include, but are not limited, to solid state memory devices suchas flash memory cards, memory sticks, and smart media cards. Such itemscan also be output to other computers or electronic devices via a localarea network, the Internet or any other type of connection.

FIGS. 9-15 are flow charts describing several different modes that canbe employed by either a digital or film camera system for creating andmaintaining the match or link between the data and the frames.

The mode shown in FIG. 9 can effectively be used when large numbers ofpictures must be taken during a very short period of time and thephotographer is not at liberty to interrupt or interfere with the eventat which the photographs are being taken. This mode is useful, forexample, when taking photographs at a graduation ceremony. It permitsthe photographer to take the picture of each graduate as he or shereceived a diploma without interfering with the ceremony.

The mode shown in FIG. 9 creates an automatic image/data match. Morespecifically, the camera generates a sequential code for each frame.This mode is particularly well suited when performing digital ratherthan film photography. Once the picture taking is complete, the framescan be viewed on the display 6 using the code or can be printed out onthe printer 7 to permit immediate proofing of the picture. Product orderinformation related to the frames can then be entered and associatedwith the code for the specific frames.

The mode shown in FIG. 10 is well suited for situations where there isan opportunity to enter data before a new subject is photographed, butthere may be a need to take multiple photographs of the same subject.The mode shown in FIG. 10 is well suited for photography of pre-schoolaged children who have a short attention span and do not alwayscooperate with the photographer. The photographer may need to take anumber of photographs to capture an image of the child which will bepleasing to the parents.

When the mode of FIG. 10 is used, the photographer begins the process ofphotographing the subject by calling up or entering identification datafor the subject. This preferably is done using the bar code reader 5 butcan also be done using the keyboard 4. The camera will continue to usethis data for this subject for each picture taken until the photographerrepeats this step for a new subject. When a picture is taken, the imageis saved to a frame (either on the film or in a digital file) with aname assigned to the frame and is linked to identification data enteredfor the subject. This process will be repeated with each picture takenuntil data for a new subject is entered.

The method shown in FIG. 10 has several risks, but also severaladvantages which make it particularly useful for pre-school photography.It is possible that a photographer will forget to enter data for a newsubject and therefore capture images for two different subjects usingone subject's identification data. When operating in this mode, thecamera cannot generate an error message if this should occur. Thedatabase, however, is sufficiently robust that, upon discovery of suchan error, the photographer can later enter or call up the identificationinformation for the second subject and edit the link to relink theframes to the correct subjects. An important advantage of this mode isthat the camera 1 is never locked and photography is paced only by therecharge time of the lights used to illuminate the subject. Thus, thesubject can be repeatedly photographed without interruption until a goodimage of the subject is captured in a frame.

Another mode of operation is shown in FIG. 11. This mode of operation iswell suited for situations where only a single photograph will be neededof each subject of a large number of subjects. This method is wellsuited for taking pictures of underclassmen for a yearbook or posedpictures of couples at a dance.

When the method of FIG. 11 is employed, identification information for asubject is entered or called up by scanning a bar code, or using thekeyboard. A picture is taken. The shutter to the camera is then lockeduntil either the photographer enters a repeat command or a bad shotcancel command. In either of these cases, the same identificationinformation will be used for the next photograph unless new subjectinformation is entered or retrieved. The method shown in FIG. 11 ensuresa higher level of data integrity. The trade-off is that an extra step isrequired to take a second picture of a subject thereby increasing thetime between pictures. This trade-off, which may not be acceptable whenphotographing preschoolers, is generally acceptable when photographingmore mature subjects.

The mode shown in FIG. 12 is very similar to the method shown in FIG.11. The only real difference is that, instead of locking the shutter,audible and visual error signals are generated.

Each of the modes discussed above permit either editing or adding dataat virtually any later point of time to the database. The system permitsthe edited or added data to be associated with a particular frame. Theremay be times, however, when it is desirable to ensure a certain set ofrequired data be entered before any photograph is taken. When this isthe case, the mode of operation shown in FIG. 13 is advantageous.

When the mode of FIG. 13 is used, required data is established during acamera set up process. Data entry is strictly enforced for each pictureby locking the shutter until all required data is entered. Only afterall the required data is entered will the computer unlock the shutter.Once the picture is taken, the shutter is again locked until thephotographer either (a) enters a bad shot cancel command (in which casethe previous picture will be deleted and the data for that picture willbe linked to the next picture); or (b) enters all the required data forthe next picture.

In still other situations, a photographer may want to take multiplepictures of the same subject, but link different data to differentpictures of the subject. This is advantageous, for example, when aphotographer is taking senior portraits of high school graduates. Thismode is shown in FIG. 14.

The mode shown in FIG. 14 allows some data to be entered at thebeginning of the photo session which is associated with each of thephotos taken, yet allows additional, optional data to be added andlinked to the different photographs taken during the session. Thelinking of such optional data may be desirable to indicate whichphotographs, given the background used or the attire worn by thesubject, would be acceptable for inclusion in the school's yearbookgiven the editorial restrictions for the yearbook established by theschool. For example if a military school has a rule requiring studentsto be in uniform in their yearbook pictures, and the subject isphotographed both in uniform and in other clothing, data can be enteredto indicate which photos are acceptable for use in the yearbook so thatonly the acceptable photos are automatically sent to the yearbook editorfor consideration.

Still another mode, shown in FIG. 15, is useful when taking team orgroup photographs. Information enabling the photograph to be linked toeach group member is entered before the group photograph is taken. Thiscan be done by scanning the card (see FIG. 8) for each team memberbefore the picture is taken. Individual members of the group may alsohave individual pictures taken. Because both the group picture and theindividual picture are linked to the particular subject, an order by thesubject that includes one or more prints of both the group picture andthe individual picture can be easily and automatically processed.

A single camera can be operated in any of the modes discussed above. Thephotographer can select between these modes based upon the need datacollection and the timing demands of the photographic session.Irrespective of the mode or type of camera (film or digital) used totake the pictures and associate the frames with the data, the advantagesof the present invention can be achieved.

When the camera 1 is used in any of the modes shown in FIGS. 9-15,creation of a link or match between the frame and the data is essential.One problem that can exist when a digital camera is used is thatpictures are taken and digital representation of the image is bufferedinto the camera's memory at a faster rate than the image can be returnedby the computer. To ensure a proper link between the digitalrepresentation of the image and data in the database, this problem mustbe addressed. FIG. 16 shows how this can be accomplished when a digitalcamera is employed. As shown, a shutter sensor 200 is coupled to thecamera 1 and the computer 2. When this sensor 200 detects a shutteractivation, the camera buffers a digital representation of thephotographic image into its internal memory and continues to buffer andprocess the image data until capture of the image in a digital form iscomplete. This process is repeated with each successive picture. Upondetection of each shutter activation (i.e., each time the digital camerabegins the process of capturing an image as a digital representation),the computer assigns a subject/link code and image file name which willbe associated with the digital representation of the photographic image(i.e., frame) when the computer retrieves it from the camera. The imagefile name and subject/image link data 45 are then loaded into the firstavailable first-in/first-out (FIFO) slot of the computer's memory. Thisprocess is then repeated for each shutter activation detected by sensor200. Periodically, the system determines whether the camera 1 has animage ready to transfer to the computer. When an image is ready fortransfer, (a) the computer reads the oldest saved image file name andsubject/image link 45 in the FIFO slots of the memory; (b) transfers theoldest image still in the camera 1 from the camera 1 to the computer 2;(c) the computer 2 processes and stores the image per the file name andlink 45 and the file name retrieved from the FIFO slots of memory arestored in the database; and (d) deletes the file name and link 45 justused from the FIFO memory slots. This process is repeated for each imagerecorded by the camera 1.

The present invention is intended for use in a highly automatedenvironment where thousands of photographers in a whole host oflocations and situations take millions of pictures of millions ofsubjects. The foregoing description of a preferred embodiment issufficient to enable one of ordinary skill to practice the invention.Changes, of course, can be made without deviating from the invention.The scope of the invention is only limited by the following claims.

1.-20. (canceled)
 21. A method of tracking digital images, the methodcomprising: obtaining a first code using one or more input devices;generating subject data identifying a subject from the first code;obtaining a second code with the one or more input devices; generatingother data from the second code; capturing an image of the subject witha digital camera; storing the image in an image file on the digitalcamera, the image file including metadata including a metadata field;and storing the subject data and the other data into the metadata fieldof the image file to associate the subject data and the other data withthe image.
 22. The method of claim 21, wherein the first code is abarcode.
 23. The method of claim 22, wherein the second code is abarcode.
 24. The method of claim 21, wherein the other data generatedfrom the second code are selected from: classroom, grade, town, andschool.
 25. The method of claim 21, wherein the subject is a firstsubject, and further comprising: capturing an image of a second subjectwith a digital camera; storing the image of the second subject in asecond image file on the digital camera, the second image file includingmetadata including a metadata field; and storing subject dataidentifying the second subject and the other data into the metadatafield to associate the subject data identifying the second subject andthe other data with the image of the second subject, wherein the subjectdata for the second subject is different than the subject data for thefirst subject and wherein the other data for the first and secondsubjects is the same when the first and second subjects share a samecharacteristic selected from: classroom, grade, group, team, town,event, and school.
 26. The method of claim 25, wherein the second codeis obtained prior to capturing an image of any subject having the samecharacteristic, and the second code is obtained only once for all of thesubjects having the same characteristic.
 27. The method of claim 21,further comprising analyzing the other data pertaining to the image byextracting the metadata stored in the image file.
 28. The method ofclaim 21, further comprising: processing the image according to theother data associated with the image to form a processed image.
 29. Themethod of claim 28, wherein processing the image includes selecting theimage based on a group number extracted from the metadata stored withthe image file.
 30. The method of claim 28, further comprising:delivering the processed image to a customer based on the other dataassociated with the image.
 31. The method of claim 28, whereinprocessing the image includes rendering the image.
 32. The method ofclaim 28, wherein the other data includes at least one requestedfinishing technique and processing the image includes modifying theimage based on the requested finishing technique.
 33. The method ofclaim 28, wherein the input device is a barcode scanner.
 34. A digitalcamera system for tracking digital images, the system comprising: animage capture device configured to capture a digital image; one or moreprocessing devices; and one or more computer readable storage devicesstoring data instructions, which when executed by the one or moreprocessing devices cause the one or more processing devices to: obtain afirst code from one or more input devices; generate subject dataidentifying a subject from the first code; obtain a second code from theone or more input devices; generate other data from the second code;capture an image of the subject with the image capture device; store theimage in an image file in the one or more computer readable storagedevices, the image file including metadata including a metadata field;and store the subject data and the other data into the metadata field ofthe image file to associate the subject data and the other data with theimage.
 35. The system of claim 34, wherein at least one of the one ormore input devices is a barcode scanner.
 36. The system of claim 34,wherein the other data are organizational information.